Description:

o9 Solutions is hiring a Senior Technical Consultant with a specialized Data Engineering background to join its Reference Data Architecture Framework (RDAF) and Manufacturing (MFG) integration team in Bangalore. In this enterprise-scale data infrastructure role, you will build and scale the ingestion and transformation pipelines that feed o9's flagship "Digital Brain" AI platform for global giants like Google, Walmart, and PepsiCo. Your primary focus will be parsing and moving multi-terabyte transactional datasets from legacy ERPs and massive data warehouses into clean, structured formats. You will own the pipeline architecture across batch and API layers, navigate complex data dependencies, and troubleshoot runtime batch automation disruptions to uphold strict customer SLAs.

Key Technical Skills:

Python, PySpark, SQL, ETL/ELT Pipelines, Data Modeling, Workflow Management (Airflow, SSIS), Large-Scale Integration (SAP ERP, Teradata, Oracle, SQL Server), Query Frameworks (Presto, Hive), File Formats (Parquet, JSON, Delta Lake), HDFS, Version Control (GitHub, Azure DevOps)

Requirements:

• 3+ years of professional hands-on software development experience specializing in big data engineering, data modeling, and end-to-end ETL architecture.
• Advanced development proficiency writing transformation scripts in Python and distributed computation jobs in PySpark.
• Expert-level SQL syntax mechanics, including deep query optimization, schema mapping, and data validation across traditional relational and warehouse architectures (such as Teradata, SQL Server, Sybase, and Oracle).
• Proven experience connecting to, extracting from, and transferring data between enterprise structures like SAP ERP, ODBC connectors, and flat files via batch orchestration or RESTful APIs.
• Strong technical familiarity working with optimized storage formats (Parquet, JSON, Delta Lake) alongside distributed query engines like Hive and Presto over HDFS environments.
• Hands-on capability scheduling, tracking, and monitoring complex data pipelines using tools like Apache Airflow or Microsoft SSIS.
• Proven ability to review code blocks, provide technical mentorship to junior consultants, and perform root-cause analysis (RCA) on failed data batches during production hypercare windows.
• Prior technical exposure to Supply Chain Planning software applications or scaling workloads across cloud hyper-scalers (AWS, Azure, or Google Cloud).